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OPTICAL OBSERVATION DEVICE AND METHOD FOR 
OBSERVING ARTICLES AT ELEVATED TEMPERATURES 



This application claims the benefit of U.S. Provisional Application Serial No. 

60/151,565 filed August 31, 1999. 



Field of the Invention 



The present invention relates generally to methods and devices for optically 
observing objects at high temperatures, including objects having significant self-emitted 
radiation. 



In a number of industries, workers still visually inspect hot, glowing objects with 
their unprotected eyes. Direct exposure to infrared (IR) radiation, however, could cause 
physical injury to the workers. Accordingly, in some instances, light shields are worn 
which attenuate the radiation, thus providing some protection against IR exposure. 
However, the use of light shields often restricts the workers' mobility. For example, 
wearing a light shield may restrict their ability to physically interact with other objects that 
are not glowing, such as tools, controls and the like. 

Conventional optical inspection devices have also been used to make 
observations/inspections of hot objects. For example, the so-called "passive method" 
utilizes a signal collector, either with CRT tubes, charge-coupled device (CCD) cameras, 
or IR cameras, to receive the self-emitted radiation from the hot objects. This approach is 
similar to the use of human vision, with the signal collectors essentially functioning as 
"eyes". The passive method, however, is subject to a phenomenon known as the "Cavity 
Radiator Effect." The Cavity Radiator Effect, postulated by Plank in 1900 and proved by 
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Einstein in the early 20th century, can deceive visual observers as to the true nature of the 
object observed. More specifically, based on this principle, concave surface features of a 
self-radiating object appear to be nearly perfect black bodies; accordingly, they may be 
mistaken as convex features. Additionally, the "illumination" is self-emitted and thus often 
carries unwanted information. Images collected via this passive method are generally not 
suitable for automatic machine vision applications. 

Another prior art approach, the so-called "active method" utilizes external lights that 
are projected onto the hot object. A camera is used to collect the reflected, as well as the 
self-emitted radiation from the hot surfaces. In the active method the idea is to overpower 
the self-emitted radiation with very strong external radiation. In other words, the reflected 
light is within the spectrum of the predominant self-emitted radiation, but is distinguishable 
based on its intensity. The external lights can be designed to highlight the surface 
information of interest such as contour and surface dimples. The external radiation can be 
provided by various light-generating devices such as high power lamps or lasers. 

Several problems, however, are associated with the active approach. First, few light 
sources exist that can overpower the radiation emitted by an object at 1350°C Second, 
the self-emitted radiation still represents a problem: it degrades the signal quality of the 
reflected radiation. The signal-to-noise ratio (external light/self-emitted light) is typically 
low unless a very powerful light source is used. Third, these external light sources may be 
undesirable in the work environment because they are so intense. 

Lasers have also been used as a light source to overpower self-emitted radiation 
from hot objects. Lasers can deliver extremely high power densities to reduce the 
significance of the self-emitted radiation. For example, a copper-based laser (radiating at 
550 nm) has been used to overpower the self-emitted radiation of laser welding pool 
(temperature at about 3000°C), which typically radiates from 230 nm to long IR. 

Another prior art approach uses YAG lasers (1060 nm) in arc welding (temperature 
at about 2500°C), which typically radiates a spectrum of from 275 nm to long IR. 
However, the use of lasers poses substantial problems. While lasers deliver high power 
density, the areas illuminated by the laser beams are small. Consequently, raster scanning 



Attorney Docket 
63,937-104 



PATENT 



is typically required when lasers are used as illumination sources. Moreover, these high 
power lasers are expensive, bulky, and pose various risks. And, in order to operate a laser- 
based system, the users must be protected with light shields and other protective 
equipment. 

The use of infrared (IR) sensors or cameras in a passive method vision system are 
also of limited value due to several factors. First, IR sensors/cameras provide significantly 
less pixel resolution than their CCD counterparts. Second, IR radiation cannot be focused 
as well as visible light due to its wavelength. Third, using IR sensors/cameras does not 
solve the problems associated with illumination or the Cavity Radiator Effect previously 
described. 

There have been attempts to use a combination of passive and active methods, but 
this approach does not resolve the issues posed by the Cavity Radiator Effect and self- 
emitted radiation. 

In the past, the difference between IR and visible light has been the focal point of 
solving the problems associated with the glare of hot objects. This approach is ill- 
conceived because a hot object can radiate with both IR and visible tight radiation. For 
instance, steel radiates at 650 nm at 1200°C; that is, steel can radiate in RED as well as IR. 
In addition, if the self-emitted radiation is not removed from the collected signal, the noise 
caused by the self-emitted radiation impairs the system's ability to gather detailed and 
accurate information about the hot object. The prior art lacks an effective means of 
removing the self-emitted radiation from the collected signal of a hot object. Finally, it is 
also believed that none of the devices enabled by the prior art is portable. This fact has 
limited the utility of such devices for certain applications. A portable device would be 
desirable for users who need to look at hot objects, but who do not need to take 
quantitative measurements. The external light sources used in prior art devices are too 
powerful and/or heavy to be low-risk and portable. In summary, the prior art approaches 
have been of limited value. The present invention overcomes these problems. 
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Summary of the Invention 

In one aspect, the present invention provides an optical system for characterizing 
the surface of a high-temperature object. The optical system has an illumination source 
which projects electromagnetic radiation toward the high-temperature object (applied 
EMR). The applied electromagnetic radiation strikes the high-temperature object and is 
reflected toward an EMR detector along with the self-emitted electromagnetic radiation and 
any ambient (background) electromagnetic radiation. At least one component of the 
reflected, applied EMR (which interacts with the surface of the high-temperature object) is 
selectively detected by the EMR detector. In one aspect, this selectively identifiable, 
reflected EMR comprises EMR having a wavelength which is determined on the basis of 
the temperature of the object; that is, based on wavelength it is distinguishable from the 
predominant self-emitted EMR and background EMR. In this manner, detection of the 
reflected EMR provides an image of the high-temperature object which simulates the object 
surface at low temperatures (i.e. below that producing any significant self-emitted EMR). 

In another aspect, the component of the reflected, applied EMR which is identified 
by the detector has a distinctive signature produced by modulating the applied EMR. In 
this aspect, the optical system of the present invention further includes an EMR modulator. 

In still another aspect, the present invention is implemented in a hand-held device. 

Brief Description of the Drawings 

Figure 1 is a diagram illustrating the present invention. 

Figure 2 is a graph illustrating the wavelengths used in the present invention to 
distinguish over the self-emitted radiation. 

Figure 3 is a diagram illustrating one possible arrangement of a camera and 
interference filter. 

Figure 4 is another diagram illustrating one possible arrangement of a camera and 
interference filter. 
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Figure 5 is another diagram illustrating one possible arrangement of a camera and 
interference filter. 

Figure 6 is graph illustrating the selection of a desired wavelength. 
Figure 7 is a graph illustrating the use of a cut-off filter in the present invention. 
Figure 8 is a graph illustrating the use of FM power modulation in the present 
invention. 

Figure 9 is a graph illustrating the use of FM mechanical modulation in the present 
invention. 

Figure 10 is a drawing of a hand-held device in accordance with the present 
invention. 

Figure 1 1 is a schematic diagram of a two-camera embodiment of the present 
invention. 

Description of the Preferred Embodiments 

Referring now to Figure 1 of the drawings, in one embodiment of the present 
invention target or object 20 is seen having self-emitted electromagnetic radiation 22. 
Object 20 will typically comprise a part, for example a carbon steel part, a titanium alloy 
part, a glass part, or a ceramic part. It will be appreciated that in a number of part 
fabrication processes, these parts are heated to temperatures in excess of 900° C. It will 
also be understood that at these high temperatures, these parts emit a substantial amount 
of radiation which obscures view of the heated part (i.e., a dominant, self-emitted EMR 
spectrum). 

Referring still to Figure 1 of the drawings, light source 24 is shown which projects 
electromagnetic radiation 26 toward the surface of part 20. Radiation 26 is the applied 
illumination. A component of applied illumination 26 is reflected by part 20 and is 
therefore illustrated in Figure 1 as reflected illumination 28. It will be noted that in tandem 
with reflected illumination 28, a portion of self-emitted radiation 22 (shown as 22') and 
some ambient radiation (not shown) takes the same path as reflected illumination 28. 
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Reflected illumination 28 (and self-emitted radiation 22') strike detector or sensor 
30. As will be explained more fully herein, by distinguishing reflected illumination 28 
from self-emitted radiation 22* (and any other "noise' 7 such as ambient radiation) detector 
30 can view object 20 as if the part were cool (essentially no self-emitted radiation). 

In this embodiment of the invention, the wavelength of reflected radiation 28 is 
chosen such that it is distinguishable by detector 30 from the wavelength of the 
predominant self-emitted radiation 22*. More specifically, and referring now to Figure 2 
of the drawings, the present invention provides an envelope of distinguishable applied 
illumination wavelengths as a function of the temperature of object 20. Accordingly, 
detector 30 senses or detects reflected illumination 28 which will have a wavelength under 
the curve. The preferred longest wavelength of reflected illumination 28 distinguishable 
from the self-emitted radiation (based on temperature) is set forth in Table 1 below: 



Temperature (°C) 


Longest Usable Wavelength (nm) 
for detection by sensor 30 


<800 


700 nm 


800 


680 


1000 


645 


1200 


596 


1400 


545 


1600 


596 


1800 


441 


2000 


385 


2200 


338 


2400 


283 


2600 


233 


3000 


220 


4000 


185 
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The wavelengths above are derived based on the assumption that object 20 is a 
blackbody radiator and will be suitable for all applications because the spectral radiation 
intensity emitted by a real surface at a given temperature of a specific wavelength is always 
less than that emitted by a black body at the same temperature and wavelength. In one 
embodiment of the present invention, the process for selecting the applicable illumination 
wavelength A 2 (arrow 26) can be determined more precisely as follows (Ozisik (1 985), Heat 
Transfer - A Basic Approach, McG raw-H i I j) : 

1 . Define the highest object Temperature T. 

2. Define the object emissivity e(T, material) which is a function of object 
temperature and material. J 

3. Obtain the self-emitted radiation spectrum based on the black body 
radiation function: 



*> e /lKT - 1 
and the material emissivity e(T) where: 



» = pi 

c = light speed 

h = Planck's constant 

* = wavelength 

K = Boltzmann constant 

emissivity function of temperature, empirically 



e 



obtained. 

Together we have the radiation spectrum as: 
(2) R(A, T, material) = s(T, material) ■ l(A, T) 
If the material is known, Equation (2) can be reduced to 
(3) R&,T) = s(T).l{A,T) 

R(A,T) can be plotted in general as the solid lines in Figure 6. To further 
simplify, e(T) can typically be assumed to be a constant. 
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4. With R (A,T), we can find a cut-off wavelength A cutHOff such that R( A cutHOff , T) 
is very small compared to the signal intensity of the external illuminating 
light n (A m ). Note that A iM is typically a shorter wavelength than A cutoff . 

where: 

r\ (A) = the intensity of the external illuminating light @ 
wavelength A. 

A m = the wavelength used for external illumination. 
Y = signal to noise ratio between the external 

illuminating light intensity and the self-emitted light 

intensity. 

Y 0 = specified signal to noise ratio limit that will satisfy 
the application. 

r|(A) is usually a function of the external illumination device. For instance, as stated 
above, a halite lamp has an n(A) like that seen in Figure 6. 

Accordingly, the longest acceptable wavelength for the projected (reflected) EMR 
is that at which a blackbody radiates a spectral radiance of 5 x 10^ W/cm 2 • nm (i.e., power 
(in watts) per unit area per unit wavelength), at the highest temperature of the hot object 
at observation. Thus, / in equation (1) above becomes 5 x 10" 4 W/cm 2 . By solving for A 
and where T equals the object's highest temperature at observation, the longest permissible 
wavelength for a given object which can be distinguished from the self-emitted radiation 
can be determined. 

Of course, the selection of A jM has to satisfy the sensitivity spectrum of detecting 
sensor 30. For instance, a CCD is sensitive to the range seen in Figure 6. A iM should be a 
wavelength which sensor 30 can detect. The A 2 in Figure 6 is suitable for applications that 
are as hot as 1 500°C. 

Illumination source 24 may take a number of forms, but it must be capable of 
generating illumination which includes the required detectable wavelength. In other 
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words, if a wavelength of 645 nm or less is required to distinguish reflected radiation 28 
from self-emitted radiation 22', then illumination source 24 must include EMR at 645 nm 
or less. One acceptable illumination source 24 is a halite lamp which emits EMR 
principally at 435 nm, 550 nm and 575 nm. Other preferred "light" sources for 
illumination source 24 are fluorescent lamps and xenon lamps. 

In the case of a laser illuminator, due to the coherent nature of the laser 
illumination, the wavelength of the laser should be set to the required wavelength in 
accordance with Table I above. 

A laser can also be used herein as a point illumination source. Detector 30 can be 
used to detect information at the point illuminated by the laser. When coupled with a 
direction set, such as a mirror set, lasers can be used to create a raster-scanned image. 
Lasers in the present invention, through the use of certain optics such as a beam expander, 
can also be used as a zone illumination source, where the zones are relatively small. 

Lasers can also be used with certain optics for structured illumination (circular lines, 
straight lines, single lines or multiple lines etc.). The structured illumination can be used 
to extract the profiles of hot objects in accordance with the present invention. Multiple 
lasers can be used for multiple points, lines, or zones. 

Of course, the intensity of the EMR projected from illumination source 24 (and the 
distances between source 24, target 22 and detector 30) must be such that sufficient signal 
strength is present at detector 30. 

Those skilled in the art will appreciate that this invention can be used in 
conjunction with other illumination methods, such as front lighting, bright field or dark 
field, and back lighting (transmissive lighting). The illumination can be collimated or 
scattered, monochromatic or color, structured or non-structured. Multiple illumination 
schemes can be applied. 

It is also possible to have multiple wavelengths of reflected illumination 28 detected 
by detector 30 in a system, as long as all of the selected wavelengths meet the criteria. 

Those skilled in the art will also understand that additional optics, such as, but not 
limited to, lenses, mirrors, optical fibers, diffusers, collimators, condensers, prisms, 
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borescopes, endoscopes, and light guides, can be used in conjunction with the embodied 
designs. These optics can be used along with the illumination device (illuminating 
radiation source and modulator) to deliver the illumination onto the targeted hot object(s) 
for the purpose of illuminating multiple spots, or illuminating multiple objects, or any other 
intended illumination designs. These optics can also be used along with the signal 
collectors to receive the radiation signals from the hot object(s) for the purpose of meeting 
space constraints or to change the observation angles, for example. 

Turning now to detector 30, a preferred detector is a CCD (charge coupled device) 
sensor. A CCD sensor is typically sensitive to wavelengths from 360 nm to 1000 nm. 
Some newer imaging sensors, such as blue enhanced CCD chips are sensitive to 
wavelengths from 175 nm to 1000 nm. 

Of course, detector 30 must be able to detect the desired reflected illumination 28 
wavelength. Preferably, an interference filter 32 blocks substantially all of the self-emitted 
EMR (and reflected EMR which is not at the desired imaging wavelength). 

Interference filter 32 may be placed in front of the detector lens 34 as best shown 
in Figure 3, or between lens 34 and imaging sensor 36 as shown in Figure 4. It may also 
comprise multiple interference filters 38 in front of imaging sensor pixels 40 as shown in 
Figure 5. Those skilled in the art can further perceive that the arrangement in Figure 5 can 
be altered to facilitate the use of multiple illumination wavelengths. In this case, different 
interference filters 38, some working at one wavelength and some working at another, will 
be placed in front of pixels 40. With this arrangement, different pixels will be sensitive to 
the signals carried by different wavelengths. It is possible to have an aggregate of pixels, 
such as 2x3 or 3x1, within which each pixel is equipped with a different interference filter. 
This distribution is similar to that of a color CCD chip. It is also possible to have one type 
of interference filter installed in one zone of the imaging sensor while another type is 
installed in another zone. 

It is also possible to facilitate the use of multiple wavelengths with multiple imaging 
sensors in a camera, with different interference filters in front of different imaging sensors. 
A prism is used to deliver optical radiations to all the imagine sensors. This arrangement 
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is similar to that of a 3-chip CCD color camera. 

Those skilled in the art can also perceive the use of cut-off filters, instead of 
interference filters, in the application. The cut-off wavelength of the cut-off filter's 
transmittance curve must be at the desired wavelength. Figure 7 illustrates the concept. 
With this setup, a single desired wavelength or multiple wavelengths can be used. In the 
case of multiple wavelengths, the signals carried by all the selected wavelengths will be 
treated as a combined signal. 

Distortions in hot object imaging come from several sources. The above-described 
approach resolves the distortion influences of IR glare and Cavity Radiators. Another task 
is to creatively resolve the distortion associated with "mirage/ 7 the optical shimmering 
effect caused by localized air density non-uniformity. This is a common experience when 
one drives on a hot summer day. The road surface can appear to be "floating" and 
"wiggling," This "mirage" effect impairs the access to accurate measurements on hot 
objects through imaging. 

In the present invention, controlled airflow 43 around hot object 20 decreases the 
temperature gradient around the hot object to remove air density distortion. Air flow 43 
will be at a pre-selected temperature such that the temperature distribution of the hot 
object is not influenced adversely by such airflow. The speed of the airflow should be 
faster than about 0.01 m/s in order to avoid localized air density non-uniformity. 

In another embodiment of the invention, and referring again to Figure 1 of the 
drawings, signal modulator 42 is provided in order to place an identifiable "imprint" on 
applied illumination 26. In other words, in this embodiment of the invention the EMR 
from source 24 has an identifiable signature (other than merely wavelength) which allows 
reflected EMR 28 to be distinguished from self-emitted EMR 22'. 

A schematic of this implementation is also shown in Figure 8. In this design, the 
power to illuminating source 24 is modulated through FM device 44. This FM signature 
will reside in the illuminating radiation 46 generated by source 24. The radiation is then 
projected onto the surface of hot object 20. The reflected signal 48 is received by imaging 
device 30 and then demodulated by FM demodulator 50 (through signal processing), based 
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on the preset FM frequency, to remove the non-modulated radiation 52, i.e., the self- 
emitted radiation. The demodulation signal processing can be performed in hardware or 
software or by a combination of both. The frequency modulation can be a sequence of 
frequencies such that the applied (projected) radiation is the nature of repeating square 
waves or can be dynamic modulation, producing a sine wave of changing frequencies 
which can be detected and demodulated as a reflected radiation. 

Modulation can also be implemented mechanically, with a mechanical gate to 
"pulse" the illuminating radiation, as illustrated in Figure 9, or as a sine wave of intensity 
charges. 

Devi ces which implement the embodied designs can be mobile, in part or as a 
whole. In one case the signal collector is mobile while the illumination device and hot 
object remain fixed. In another case the signal collector and the illumination device are 
both mobile and the hot object is stationary. It is also possible to move the hot object 
while the signal collector and the illumination device are stationary or mobile. It is also 
possible that two signal collectors or two illumination devices are used in one application, 
within which one is mobile and the other is stationary. 

In still another embodiment, the present invention is implemented in the form of 
hand-held device 58. Referring now to Figure 10 of the drawings, hand-held camcorder 
60 is shown having projection light 62 and interference filter 64. Camcorder 60, which 
may be digital or analog, is used as the signal collector. Interference filter 64 (preferably 
at 435 nm) is placed in front of the lens. External projection light 62 provides the applied 
illumination and radiates with a significant intensity (at 435 nm in this example). Light 62 
could be fixed to the surface of camcorder 60 or be separate to provide multiple 
illumination angles. Camcorder 60 could use a magnetic tape, RAM, or any other suitable 
data storage device, or the device could be used simply as a display monitor. The video 
signal can be exported to a TV, a monitor, or a PC. Hand-held device 58 could be battery 
operated or could operate through an AC power supply. This device can be used to 
observe the hot processes or objects in accordance with the present invention, i.e. by 
projecting the desired illumination at a hot object and viewing the image (with the self- 
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emitted radiation filtered out) with the camcorder. 

In another implementation, multiple signal collectors, such as cameras, can be used 
in one system to provide multiple viewpoints of the hot object. The use of multiple 
cameras can facilitate stereo imaging, which provides a three-dimensional image of the hot 
object. Also, multiple cameras can be used for multiple wavelengths, with each camera 
demodulating the signal carried by one wavelength. 

In another embodiment and referring now to Figure 1 1, the invention can be used 
to protect individuals who must interact with hot objects. More specifically, in this design, 
two cameras 70,72 are used to capture the same field of view, with one capturing a normal 
image 74, which can be color or black/white, and the other capturing an image based on 
this invention 76 using beam splitter 77 and interference filter 79. In the normal image 74, 
hot object 78 is glowing. Glowing object 78 can be identified through a device, such as 
but not limited to, portable signal processor 82. With hot object 78 identified, the normal 
images of the glowing object can be replaced by room-temperature-appearance 
counterparts (cut out from 76 and pasted into 74). The synthesized image will be 
displayed to those who need to see everything in the field of view. Display 80 can be a 
monitor, a TV, or any other displaying device, including a displaying goggle. In order to 
identify the hot objects in the synthesized image, an indicator, such as, but not limited to, 
a red flashing boundary can be applied to the hot objects. 

Example 

An example of the present invention in one embodiment is as follows: 

1 . The external illumination source is a halite lamp. The halite radiation 
consists of three principal wavelengths, 435 nm, 550 nm, and 575 nm. The radiation at 
435 nm is the most useful wavelength in this design because it is the farthest one away 
from the self-emitted radiation of a hot object. The hot object must be at a temperature of 
1800° C or hotter for its self-emitted radiation to cover 435 nm, assuming the hot object 
is close to a black body. 

2. The external radiation is projected onto the hot object and interacts 
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all three distinct wavelengths), the self-emitted radiation from the hot object, and any other 
radiation present are all blended together. 

3. The blended radiation is then passed through an interference filter, 
which has a working wavelength at 435 nm. That is, only the radiation at 435 nm 

5 wavelength can pas through this interference filter. All other radiation will be blocked. 
This interference filter can be placed in front of the lens, or in front of the imaging sensor. 

4. Only radiation with the pre-selected wavelength, in this case 435 nm, 
can reach the imaging sensor. 

5. The hot object will appear to the image sensor, say a CCD chip, as 
IQ though it were at room temperature. 

;}{ 6 - The demodulated 435 nm signal is then translated into an electronic 

\ii signal. 

7. The electronic signal may be processed by a CPU, stored to a media, 
displayed on a monitor for observation by a human or any other form of processing. 
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